This report details findings of an analysis of employment in London between 2004-2019. This data is publicly available from the Annual Population Survey, produced by the Office for National Statistics, obtained via the City of London’s website. We were able to analyze trends in types of employment, employment status, and employment growth.
This project was of interest because London is a large international community that provides a snapshot into the economic situation of the world. Employment is a good indicator of social and economic success and independence that allows us to quantitatively understand how the role of women have changed. Furthermore, because London is such a primary node in the global economic network, it should be impacted by major global events such as the Syrian Refugee Crisis beginning in Fall 2017, the Globabl Financial Crisis (GFC) of 2007-2008, and the departure of United Kingdom from the EU “Brexit” which was announced in March 2017.
Upon considering the data available, the following questions are viable:
We used two datasets in this analysis. The first one contains the employment rates broken down by major occupation group and gender during 2004 to 2019. This dataset was split into multiple sheets by year and for each year untidy data was recorded. Here is an example of what the dataset excel spreadsheet looks like:
Here you can see that the data is divided by male and female and occupation group. This means that there are 18 big columns with 4 smaller columns each. Furthermore, the dataset also contains data for other parts of the UK. By only taking the smaller numerator column for each of the 18 big columns, there are a total of 18 variables recorded for each burough (of which there are 32), for each year between 2004-2019. There are 9 major occupation groups that this dataset is grouped into:
To prepare this data for the analytical methods below, we had to alter the variables to a more compact name such as M1, M2, F1, F2, etc with M or F denoting gender and 1-9 denoting occupation group. We selected only the smaller numerator columns to be the values for each of the 18 variables and removed the data recorded for areas outside of London and its boroughs and changed the values listed as “!” to NA. We did this for each year individually since they were split onto different tabs in the excel spreadsheet. Then, we had to combine all of the dataframes created and add another variable which we called Year. Throgh further analysis, we discovered that some data in 2014 was incorrectly inputed since there were decimal values in the numerator even though the dataset says that the numerator was rounded to the nearest whole number, so we had to discard all the data from 2014. Here is an example of what the tidied dataset looks like:
Employment in London by Gender and Borough
| Area | M1 | M2 | M3 | M4 | M5 | M6 | M7 | M8 | M9 | F1 | F2 | F3 | F4 | F5 | F6 | F7 | F8 | F9 | Year |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Barnet | 13700 | 20200 | 17500 | 5300 | 8000 | 1700 | 6300 | 5200 | 5500 | 6600 | 13800 | 11400 | 15200 | 0 | 7700 | 7600 | 0 | 4100 | 2004 |
| Bexley | 6200 | 8600 | 10200 | 4800 | 12000 | 1800 | 2200 | 7300 | 4000 | 3100 | 5500 | 5600 | 19400 | 800 | 6500 | 6600 | 0 | 2500 | 2004 |
| Brent | 8800 | 14200 | 6700 | 7700 | 10200 | 1000 | 4600 | 4800 | 8500 | 3500 | 10600 | 8300 | 11700 | 1000 | 4300 | 4600 | 0 | 6700 | 2004 |
| Barnet | 15700 | 18800 | 17900 | 7200 | 8600 | 1400 | 6900 | 3900 | 1700 | 5500 | 17300 | 12900 | 16500 | 0 | 10200 | 3500 | 0 | 4800 | 2005 |
| Bexley | 8000 | 10200 | 8800 | 2900 | 15100 | 1100 | 2900 | 4300 | 2700 | 1300 | 6400 | 7100 | 19000 | 0 | 5900 | 4800 | 1100 | 6400 | 2005 |
| Brent | 9200 | 14300 | 11700 | 5600 | 9800 | 1600 | 3600 | 4000 | 9300 | 4600 | 11200 | 7800 | 14800 | 0 | 4900 | 5000 | 800 | 2000 | 2005 |
In cleaning up this dataset, we created three separate dataframes corresponding to the three datasets: one for total employment rates, one for female employment rates, and one for male employment rates. Each one of these datasets included a span of months of a year in one column, as well as names of each region of the UK, the total number of people employed within that region, the total number of people in that region, and the employment rate percentage in that region. In order to clean this up, we separated out the quarter and the year, as we were mainly concerned with the average employment rates for an individual year, rather than an individual quarter.
We then got rid of all columns regarding the number of people and specifically focused on the percentages given. This was done for all three dataframes until the data was sufficiently cleaned. The challenge of this cleanup was definitely separating the dataframes up and figuring out how to get the columns formatted in a useful way. To do this, we skipped the first row in each dataset, and selected for anything that contained a “%” for each of the three datasets to get specifically the percentages. Then we created column names which were each of the regions of the UK that were originally in the dataset. This concluded our cleaning of the columns. Next we were only concerned with the data from 2000 to present, so we got rid of any rows/years that did not fit in that category. The final problem to tackle in this cleanup was to understand the quarters better, as the way the months ranged had many overlaps, and each year was divided up in many separate “quarters” of a year, instead of four generic ones. Therefore, we got rid of any rows that did not correspond to a set quarter (Jan-Mar, Apr-Jun, Jul-Sep, Oct-Dec).
This section contains the methods and results obtained for the questions stated above.
What occupations are dominated by women and which are dominated by men? How have these ratios changed over time?
We approached this question first by determining the which occupations primarily are held by women over all of the years in the dataset except for 2014. The following bar graph displays the average gender ratio for each occupation.
| Code | Occupation |
|---|---|
| 1 | managers, directors and senior officials |
| 2 | professional occupations |
| 3 | associate prof & tech occupations |
| 4 | administrative and secretarial occupations |
| 5 | skilled trades occupations |
| 6 | caring, leisure and other service occupations |
| 7 | sales and customer service occupations |
| 8 | process, plant and machine operatives |
| 9 | elementary occupations |
From this graph, we can see that, on average. there are 3 occupations which are female dominated. The occupation codes are 4, 6, and 7 which correlate with administrative and secretarial occupations, caring, leisure and other service occupations, and sales and customer service occupations. The fact that all three of these occupations are primarily held by women did not surprise us. We looked further into this by making a bar graph for each occupation to see how the gender ratio changed over time.
Comparatively, when looking at the change in ratios between male and gender for each occupation over time, we can see that occupations 4,6, and 7 have remained majority female for a long period. We can also see that in 2019, occupation 9 became majority female. In order to look more into this, we created bar graphs for occupations 4, 6, 7, and 9 that are not proportioned.
## # A tibble: 30 x 4
## Year occupation n gender
## <dbl> <chr> <dbl> <chr>
## 1 2004 2 419900 Male
## 2 2004 2 339200 Female
## 3 2005 2 424900 Male
## 4 2005 2 345600 Female
## 5 2006 2 426000 Male
## 6 2006 2 373400 Female
## 7 2007 2 430500 Male
## 8 2007 2 373800 Female
## 9 2008 2 454000 Male
## 10 2008 2 377100 Female
## # ... with 20 more rows
Here we can see that every occupation group except four were increasing in number of total employees from 2004-2015, after which there is a decline.
In summary, there are three occupation groups that are female dominated.
Which parts of London have the most equal ratios of employment based on gender? The least? How do these employment ratios reflect the overall employment rate for each borough??
We first find the top 8 boroughs for highest and smallest percentage of female employees.
Here are two tables to show the findings.
Best 8 Boroughs with high female employee Percentages:
| Area | percentage |
|---|---|
| Wandsworth | 0.4844019 |
| Bexley | 0.4769110 |
| Bromley | 0.4735575 |
| Havering | 0.4725535 |
| Croydon | 0.4710733 |
| Richmond upon Thames | 0.4704343 |
| Islington | 0.4664992 |
| Kingston upon Thames | 0.4664541 |
Worst 8 Boroughs with high female employee Percentages:
| Area | percentage |
|---|---|
| Hounslow | 0.4370293 |
| Ealing | 0.4369399 |
| Kensington and Chelsea | 0.4311912 |
| Brent | 0.4297954 |
| Redbridge | 0.4229794 |
| Westminster | 0.4219812 |
| Newham | 0.3816559 |
| Tower Hamlets | 0.3804857 |
Here is a colored map of the findings above:
## Regions defined for each Polygons
Boroughs with percent difference between male and female employees less than 0.1:
We attempted to look at the gender ratio for the top and worst boroughs over time. However, due to the miniscule ups and downs, the two figures below could not be analyzed as we had hoped.
We then decided to use the number of female employees for each of the above bouroughs instead.
In the first graph, it is clear that the number of female employees has generally increased for all boroughs from 2004-2019. However, in the second graph there does not seem to be a huge difference from 2004 to 2019 except for Tower Hamlets, Newham and Brent.
| Area | Top 3 Occupation Groups |
|---|---|
| Barking and Dagenham | nine, two, four |
| Barnet | two, three, one |
| Bexley | two, four, three |
| Brent | two, three, nine |
| Bromley | two, three, four |
| Camden | two, three, one |
| Croydon | two, three, four |
| Ealing | two, three, one |
| Enfield | two, three, four |
| Greenwich | two, three, nine |
| Hackney | two, three, one |
| Hammersmith and Fulham | two, three, one |
| Haringey | two, three, nine |
| Harrow | two, four, three |
| Havering | two, four, three |
| Hillingdon | two, three, four |
| Hounslow | two, three, one |
| Islington | two, three, one |
| Kensington and Chelsea | three, two, one |
| Kingston upon Thames | two, three, one |
| Lambeth | two, three, one |
| Lewisham | two, three, four |
| Merton | two, three, one |
| Newham | nine, two, three |
| Redbridge | two, three, four |
| Richmond upon Thames | two, three, one |
| Southwark | two, three, one |
| Sutton | two, three, four |
| Tower Hamlets | two, three, nine |
| Waltham Forest | two, three, four |
| Wandsworth | two, three, one |
| Westminster | two, three, one |
From the table above, we discovered that the top 3 occupations of each borough was highly going to include both two and three.
Therefore, we decided to look more at the numbers instead of the percentages.
| Area | Num_females |
|---|---|
| Croydon | 83700.00 |
| Wandsworth | 83286.67 |
| Barnet | 78833.33 |
| Lambeth | 75573.33 |
| Bromley | 73200.00 |
| Ealing | 69366.67 |
| Southwark | 66753.33 |
| Lewisham | 65633.33 |
| Enfield | 61780.00 |
| Brent | 61433.33 |
| Hillingdon | 59533.33 |
| Haringey | 55560.00 |
| Hounslow | 54826.67 |
| Havering | 54213.33 |
| Greenwich | 53813.33 |
| Hackney | 53733.33 |
| Waltham Forest | 53560.00 |
| Redbridge | 53293.33 |
| Bexley | 53160.00 |
| Islington | 50566.67 |
| Camden | 50286.67 |
| Newham | 49926.67 |
| Harrow | 49806.67 |
| Merton | 47020.00 |
| Westminster | 46820.00 |
| Richmond upon Thames | 46420.00 |
| Sutton | 45653.33 |
| Tower Hamlets | 45433.33 |
| Hammersmith and Fulham | 43613.33 |
| Kingston upon Thames | 38586.67 |
| Barking and Dagenham | 34226.67 |
| Kensington and Chelsea | 32820.00 |
Which occupations are growing in London and is this due to more women being employed in these occupations? Which are shrinking?
## Saving 7 x 5 in image
## Saving 7 x 5 in image
## Saving 7 x 5 in image
## Saving 7 x 5 in image
## Saving 7 x 5 in image
## Saving 7 x 5 in image
## Saving 7 x 5 in image
## Saving 7 x 5 in image
## Saving 7 x 5 in image
## Saving 7 x 5 in image
We want to see if there is a difference in percentage of each occupation group across the years: which occupation groups have increased and which have decreased.
It’s shocking that the tech occupation group did not increase as we had expected.
To see the changes in employment rates in recent times, we wanted to do a line chart to observe what the trend has been leading up to 2020. A line chart helps us to visualize and easily compare female employment rates to male employment rates over time. We found that employment rates actually went up equally for both genders in the first quarter of 2020 in comparison to the average of 2019, which was slightly unexpected because of the pandemic. However, in the future, it may be beneficial to create a bar graph of the data for each quarter from 2018 to further into 2020 in order to get a zoomed in look at what was and is happening. This could be important because it may show trends that were smoothed out when we averaged by year instead of by quarter. Employment rates have restabilized over the past 10 years since the 2008 crisis, and slight changes in the first quarter of 2020 may foreshadow what is to come, or may reflect the decisions countries made in their response to the pandemic. It will be interesting to see how the data continues to trend in the future to see the long term effects.
Question 5
Firstly, when looking into the data surrounding the 2008 financial crisis, we wanted to create a line graph that ranged over the years leading up to and directly after 2008 in various regions. Line graphs allow us to visualize the trends, and in our case, we can look at how the trends are different over the years according to gender.
Average Female Employment Rate in London vs the UK (2005-2015) In looking at this graph, it can be seen that the employment rates for females in London have for the most part parallelled female employment rates for the rest of the UK excluding London. However, it is interesting to see that the average female employment rate for the UK excluding London is consistently many percentage points higher than it is within the city limits. London’s female employment rates were beginning to risel however, after 2008 there was a decline for a few years before an eventual steep increase, much higher than in the years leading up to the crisis.
Average Male Employment Rate in London vs the UK (2005-2015) Firstly, when comparing this graph to the previous graph involving female employment rates, it is clear that, though the graphs have a similar range in percent, the fluctuations in average employment rates were much more drastic for males than for females. Furthermore, though employment rates have risen significantly, they haven’t reached the levels they were at leading up to the crisis. Additionally, it is interesting to note that before the crisis, London’s average male employment rate was lower than the rest of the UK until the crisis. In the aftermath, it increased drastically and eventually overcame employment rates in the rest of the UK, showing that unemployment was on the rise and a higher percentage of men living in the city were employed than outside of the city.
Average Employment Rate in London by Gender (2005-2015) This graph outlines a side by side comparison of female, male, and total persons employment rates throughout the 2008 crisis. It is clear that, though each gender was affected by the crisis, it seems as though women were affected less, and have had a steady increase in employment rates. However, female employment rates are consistently lower than those of male employment rates by a large margin the entire time leading up to and following the crisis. This led me to wonder if there was anything interesting in the data surrounding the “gap” in employment rates between the two genders.
Difference in Employment Rates in London (2004-2015). To change things up from line graphs, we looked at a bar graph representing the gap between male and female employment rates (average male employment rate - average female employment rate) over time. Though the gap remained relatively uniform (as to be expected as the line graphs mirrored eachother), it is clear that after 2008, the gap decreased slightly. This was because of the fact that so many fewer males were employed, while female employment was not as affected. This may have been because many men held jobs in business that were affected by the crisis, while the jobs that women hold would have remained more stable. It is interesting to note that the gap has not begun to widen back up again even years following the crisis.
Average Male Employment Rate by Region (2000-2020) & Average Female Employment Rates by Region (2000-2020) We next wanted to see how England compared to the rest of the UK in the last 20 years. We see a similar trend over a large scale as we did within London, as male employment rates were much more dramatically impacted by the 2008 crisis than female employment rates were. In fact, as can be seen in the next graph, while male employment rates from 2000 to 2020 were working to get back to previous employment rates, female employment rates took less of a hit and have shown a general upward trend. In addition, in the first part of 2020, while female jobs in England and Scotland continued on their upward trend, other countries like Wales and Northern Ireland saw decreases in their employment rates. This was likely because of COVID19, though we cannot say with 100% confidence. Male employment rates continued to rise in England, however, countries like Scotland and Wales have seen decreases.
Average Total Employment Rate By Region (2000-2020) This graph was made and useful because it showed, regardless of gender, that England continued to see an increase in employment rates through the first quarter of 2020, while every other country saw either a decrease in employment rates, or a slower increase in employment rates than in previous years. This would be on par with expectations due to the covid-19 pandemic, because England waited to implement quarantine procedures longer than the other countries in the UK and therefore would not have seen the impacts the pandemic had created until later.
Difference in Employment Rate By Region (2000-2020) This graph was interesting to look at because it can be seen that the gap in employment rate between men and women is on a relatively steep decline since the turn of the century. However, when you compare this to a previous bar graph highlighting the uniformity of London’s gender gap in employment rates between 2004 and 2015, it becomes clear that London followed a similar trajectory as England, and this was somewhat higher than nearly any other country in the UK throughout these two decades. In fact, the gender gap in England has been almost always higher than any other country in the UK in the last 10 years, with the exception of Northern Ireland. This may have been because so much of the population of England resides in London, and the gender gap in employment rates has not seen the dramatic decreases that other countries have seen.
In conclusion, there are three main female dominated occupation groups in London and it’s economy has also been affected by crises such as the 2008 financial crisis and CovID 19. The gap in employment rates by gender in London actually does not represent all of England like we had thought it would. In fact, there is a lower percentage of female employees in London compared to everywhere else.